Ref 

# 


Hits 


Search Query 


DBs 


Default 
Operator 


Plurals 


Time Stamp 


LI 


20 


(user adj interaction adj captur$4) 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 17:32 


L2 


3211 


(process adj captur$4) 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 17:32 


L3 


83 


(process adj captur$4) and 
(model$4 adj process) 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 18:52 


L4 


2 


"6278977".pn. 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 18:59 


L6 


467 


business adj process adj model$4 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 18:59 


L7 


7 


business adj process adj model$4 
with captur$4 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 19:39 


L8 


1 


"1318679".pn. 


EPO 


OR 


ON 


2006/01/26 19:40 


L9 


2 


"5826239".pn. 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 19:42 


L10 


2 


"6023683".pn. 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 19:43 


Lll 


2 


"5233513".pn. 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM TDB 


OR 


ON 


2006/01/26 19:43 



Search History 1/26/2006 7:50:37 PM Page 1 

C:\Documents and Settings\mtran3\My Documents\EAST\Workspaces\Default EAST Workspace (Flat Panel).wsp 



L12 


2 


"5581691".pn. 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 19:46 


L13 


2 


"6345239".pn. 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


ON 


2006/01/26 19:46 


L14 


2 


"6415297".pn. 


US-PGPUB; 

1 ICDATi 

USPAT; 

EPO; JPO; 
DERWENT; 
IBM TDB 


OR 


ON 


2006/01/26 19:47 



Search History 1/26/2006 7:50:37 PM Page 2 

C:\Documents and Settings\mtran3\My Documents\EAST\Workspaces\Default EAST Workspace (Flat Panel).wsp 



- -Results (page 1): user action capturing 



Page 1 of 7 



# PORTAL 



USPTO 



Subscribe (Full Service) Reg ister (Limited Service, Free) Login 

Search: ® The ACM Digital Library O The Guide 
[ user action capturing 



Terms used user action capturing 



Feedback Report a problem Satisfaction 
survey 

Found 49,450 of 169,866 



Sort results | re | evance SI ^ Save results to a Binder Try an AdvapcM .Search 

bv I =l r» Try this search in The ACM Guide 



by 
Display 
results 



1 — r w S earch Tips 

expanded form Ej fj o pen results in a new 
window 



Results 1 - 20 of 200 
Best 200 shown 



Result page: 1 2 3 4 5 6 7 8 9 10 n ext 

Relevance scale □ □ H H ■ 



1 WebQuilt: a framework for capturing and visualizing the web experience 
Jason I. Hong, James A. Landay 

April 2001 Proceedings of the 10th international conference on World Wide Web 

Publisher: ACM Press 

Full text available: ^ pdf(611.22 KB) Additional Information: full citation , references , citings , index terms 



Keywords: WebQuilt, log file analysis, usability evaluation, web proxy, web visualization 



Late breakin g results: post e rs: Desi gn ing s ystems that direct hu man actio n 
Ana Ramirez Chang, Marc Davis 

April 2005 CHI '05 extended abstracts on Human factors in computing systems 
Publisher: ACM Press 

Full text available: *g| pdf(1 66.64 KB) Additional Information: full citation , abstract , references , index terms 

In this paper we present a user-centered design process for Active Capture systems. 
These systems bring together techniques from human-human direction practice, 
multimedia signal processing, and human-computer interaction to form computational 
systems that automatically analyze and direct human action. The interdependence 
between the design of multimedia signal parsers and the user interaction script presents a 
unique challenge in the design process. We have developed an iterative user-centered ... 

Keywords: active capture, direction, error, error-prone systems, mediation, multimedia 
systems design, recognition 



3 Presiding over accidents: system direction of human action 

Jeffrey Heer, Nathaniel S. Good, Ana Ramirez, Marc Davis, Jennifer Mankoff 
April 2004 Proceedings of the SIGCHI conference on Human factors in computing 

systems 
Publisher: ACM Press 

Full text available: ^ pdf (406.79 KB) Additional Information: full citation , abstract , references , index terms 

As human-computer interaction becomes more closely modeled on human-human 
interaction, new techniques and strategies for human-computer interaction are required. 




http://portal.acm.org/resultsxfm?coll=ACM&dl=ACM&CFID=66809325& 1/26/2006 



Results (page 1): user action capturing 



Page 2 of 7 



In response to the inevitable shortcomings of recognition technologies, researchers have 
studied mediation: interaction techniques by which users can resolve system ambiguity 
and error. In this paper we approach the human-computer dialogue from the other side, 
examining system-initiated direction and mediation of human action. We conduc ... 

Keywords: active capture, direction, error, error-prone systems, mediation, multimedia 
systems design, recognition 



The state of the art in automating usability evaluation of user interfaces 
Melody Y. Ivory, Marti A Hearst 

December 2001 ACM Computing Surveys (CSUR), volume 33 issue 4 
Publisher: ACM Press 

Full text available- Wl pdf(2 31 MB) Additional Information: full citation , abstract , references , citings, index 
. j^ij . terms, review 

Usability evaluation is an increasingly important part of the user interface design process. 
However, usability evaluation can be expensive in terms of time and human resources, 
and automation is therefore a promising way to augment existing approaches. This article 
presents an extensive survey of usability evaluation methods, organized according to a 
new taxonomy that emphasizes the role of automation. The survey analyzes existing 
techniques, identifies which aspects of usability evaluation aut ... 

Keywords: Graphical user interfaces, taxonomy, usability evaluation automation, web 
interfaces 



5 Posters: Automated evaluation of search engine performance via implicit user 




feedbac k 

Himanshu Sharma, Bernard J. jansen 

August 2005 Proceedings of the 28th annual international ACM SIGIR conference on 
Research and development in information retrieval SIGIR '05 

Publisher: ACM Press 

Full text available: ^ pdf( 231 .8 6 KB) Additional Information: fuli citation , abstract , references , index terms 

Measuring the information retrieval effectiveness of Web search engines can be expensive 
if human relevance judgments are required to evaluate search results. Using implicit user 
feedback for search engine evaluation provides a cost and time effective manner of 
addressing this problem. Web search engines can use human evaluation of search results 
without the expense of human evaluators. An additional advantage of this approach is the 
availability of real time data regarding system perform ... 



Keywords: implicit user feedback, search engine evaluation 



6 Poster 3: content track: Trackin g users' capture intention: a novel complementar y 
view for home video content analy sis 
Tao Mei, Xian-Sheng Hua, He-Qin Zhou 

November 2005 Proceedings of the 13th annual ACM international conference on 
Multimedia MULTIMEDIA 05 

Publisher: ACM Press 

Full text available: ^| pdf(1 .86 MB) Additional Information: full citation , abstract, references , index terms 

In this paper, we present a novel view to home video content analysis, which aims at 
tracking the capture intention of camcorder users. Based on the study of intention 
mechanism in psychology, a set of domain-specific capture intention concepts are defined. 
A comprehensive and extensible scheme consisting of video structuring, intention oriented 
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feature analysis, as well as intention unit segmentation and classification is proposed to 
mine the users' capture intention. Experiments were ca ... 

Keywords: attention detection, capture intention, video content analysis 

7 Please touch tan g ible Uls: Hands-only scenarios and video action walls: novel 

methods for tangible user interaction desi gn 
^ Jacob Buur, Mads Vedel Jensen, Tom Djajadiningrat 

August 2004 Proceedings of the 2004 conference on Designing interactive systems: 

processes, practices, methods, and techniques 
Publisher: ACM Press 

Full text available: ^[ pdf(4.32 MB) Additional Information: full citation , abstract , references , index terms 

In our research on tangible user interaction we focus on the design of products that are 
dedicated to a particular user, task and context. In doing so, we are interested in 
strengthening the actions side of tangible interaction. Currently, the actions required by 
electronic products are limited to pushing, sliding and rotating. Yet humans are capable of 
far more complex actions: Human dexterity is highly refined. This focus on actions 
requires a reconsideration of the design process. In this pap ... 

Keywords: human actions, scenarios, tangible interaction, video 



Supportin g adaptive interf a ces in a knowled g e-based user interface environment 
Piyawadee Noi Sukaviriya, James D. Foley 

February 1993 Proceedings of the 1st international conference on Intelligent user 
interfaces 

Publisher: ACM Press 

Full text available: ^pdf( 814.93 KB ) Additional Information: full citatio n, references , citings, index terms 



Keywords: adaptive help, adaptive interface, user interface design environment, user 
model 



9 WebQuilt: A proxy-based approach to remote web usability testing 

^ July 2001 ACM Transactions on Information Systems (TOIS), volume 19 issue 3 
^ Publisher: ACM Press 

Full text available* 15) pdf(2 89 MB) Additional Information: full citation , abstract , references , citings, index 
" terms , review 

WebQuilt is a web logging and visualization system that helps web design teams run 
usability tests (both local and remote) and analyze the collected data. Logging is done 
through a proxy, overcoming many of the problems with server-side and client-side 
logging. Captured usage traces can be aggregated and visualized In a zooming interface 
that shows the web pages people viewed. The visualization also shows the most common 
paths taken through the web site for a given task, as well as the optimal p ... 

Keywords: Usability evalution, WebQuilt, log file analysis, web proxy, web visualization 

10 Extractin g usability information from user interface events 
^ David M. Hilbert, David F. Redmiles 

>^ December 2000 ACM Computing Surveys (CSUR), Volume 32 Issue 4 
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Publisher: ACM Press 

Full text available: fiB pdff1.50 MB) Additional Information: full citation , abstract, references, citings, index 
^ terms , review 

Modern window-based user interface systems generate user interface events as natural 
products of their normal operation. Because such events can be automatically captured 
and because they indicate user behavior with respect to an application's user interface, 
they have long been regarded as a potentially fruitful source of information regarding 
application usage and usability. However, because user interface events are typically 
voluminos and rich in detail, automated support is generally ... 

Keywords: human-computer interaction, sequential data analysis, usability testing, user 
interface event monitoring 



11 A second g eneration user interface desi g n environment: the model and the runtim e 
architecture 

Piyawadee Sukaviriya, James D. Foley, Todd Griffith 

May 1993 Proceedings of the SIGCHI conference on Human factors in computing 

systems 
Publisher: ACM Press 

Full text available: fg| pdf(1.12 MB) Additional Information: full citation, abstract , references , citings, index 

t erms 

Several obstacles exist in the user interface design process which distract a developer 
from designing a good user interface. One of the problems is the lack of an application 
model to keep the designer in perspective with the application. The other problem is 
having to deal with massive user interface programming to achieve a desired interface 
and to provide users with correct help information on the interface. In this paper, we 
discuss an application model which captures information about ... 

Keywords: application model, automatic help generation, user interface design 
environment, user interface generation, user interface model 



1 2 Brid gi n g the physical and the di g ital: Whe r e the wild thin g s work: ca pturin g shared 
physical design workspaces 

Wendy Ju, Arna Ionescu, Lawrence Neeley, Terry Winograd 

November 2004 Proceedings of the 2004 ACM conference on Computer supported 
cooperative work 

Publisher: ACM Press 

Full text available: ^g)p df(1.31 MB) Additional Information: full citation , abstract , references , index term s 

We have built and tested WorkspaceNavigator, which supports knowledge capture and 
reuse for teams engaged in unstructured, dispersed, and prolonged collaborative design 
activity in a dedicated physical workspace. It provides a coherent unified interface for 
post-facto retrieval of multiple streams of data from the work environment, including 
overview snapshots of the workspace, screenshots of in-space computers, whiteboard 
images, and digital photos of physical objects. This paper describes t ... 

Keywords: collaborative design, knowledge capture/reuse, memory augmentation, 
physical environments, workspaces 
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^ Thomas Ostrand, Aaron Anodide, Herbert Foster, Tarak Goradia 

V March 1998 ACM SIGSOFT Software Engineering Notes , Proceedings of the 1998 ACM 
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SIGSOFT international symposium on Software testing and analysis 

ISSTA '98, Volume 23 Issue 2 
Publisher: ACM Press 

Full text available- pdf(2. 05 MB) Additional Information: full citation , abstract , references , citings , index 
'T^> terms 

We have implemented an experimental test development environment (TDE) intended to 
raise the effectiveness of tests produced for GUI systems, and raise the productivity of 
the GUI system tester.The environment links a test designer, a test design library, and a 
test generation engine with a standard commercial capture/replay tool. These 
components provide a human tester the capabilities to capture sequences of interactions 
with the system under test (SUT), to visually manipulate and modify the s ... 

Keywords: GUI-based system, capture/reply, test coverage, test designer, test 
generation, test maintenance, test scenario, testing, visual editor 



14 Image and shape analysis - user interaction: Implicit interaction profiling for 
recommendin g s patial content 
Joe Weakliam, Michela Bertolotto, David Wilson 

November 2005 Proceedings of the 13th annual ACM international workshop on 
Geographic information systems GIS '05 

Publisher: ACM Press 

Full text available:^ pdf(754. 07 KB) Additional Information: full citation , abstract , references , index terms 

When individuals request task-relevant spatial content in the form of area maps, GIS 
applications typically return default maps displaying standard map content. Little effort is 
made by these applications to present users with personalized maps displaying spatial 
content tailored to users' specific interests. Maps generated usually contain superfluous 
information that hinders the user's end goal and is irrelevant in terms of their spatial 
content preferences. Users may then customize the map thr ... 

Keywords: data mining, implicit profiling, personalization, user interaction, user 
modeling 





15 Hel pin g the automated validation process of user interfaces systems 
Bruno d'Ausbourg, Christel Seguin, Guy Durrieu, Pierre Roche 

April 1998 Proceedings of the 20th international conference on Software engineering 

Publisher: IEEE Computer Society 

Full text available: fQ pdf (988.94 KB) 

jS Additional Information: full citation , references , index terms 

^ Publisher Site 



16 Interactive control of avatars animated with human motion data 
A. Jehee Lee, Jinxiang Chai, Paul S. A. Reitsma, Jessica K. Hodgins, Nancy S. Pollard 
>^ July 2002 ACM Transactions on Graphics (TOG) , Proceedings of the 29th annual 
conference on Computer graphics and interactive techniques SIGGRAPH 

'02, Volume 21 Issue 3 
Publisher: ACM Press 

Full text available* 13 odf(8 00 MB) Additional Information: full citation , abstract , references , citings , index 

terms 

Real-time control of three-dimensional avatars is an important problem in the context of 
computer games and virtual environments. Avatar animation and control is difficult, 
however, because a large repertoire of avatar behaviors must be made available, and the 
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user must be able to select from this set of behaviors, possibly with a low-dimensional 
input device. One appealing approach to obtaining a rich set of avatar behaviors is to 
collect an extended, unlabeled sequence of motion data appropria ... 

Keywords: avatars, human motion, interactive control, motion capture, virtual 
environments 



17 Reco g nizin g creative needs in user interface desi gn 
^ Michael Terry, Elizabeth D. Mynatt 

>7 October 2002 Proceedings of the 4th conference on Creativity & cognition 
Publisher: ACM Press 

Full text available - 151 pdf(478 46 KB) Aclc, itional Information: full citation , abstract , references , citings, index 
^ : terms 

The creative process requires experimentation, the exploration of variations, and the 
continual evaluation of one's progress. While these processes are frequently non-linear 
and iterative, modern user interfaces do not explicitly support these practices, and instead 
impose a linear progression through tasks that is a poor fit for creative pursuits. In this 
paper we use data from three case studies, and draw upon Sch$#246;n's theory of 
reflection-in-action to illustrate specific deficiencies in c ... 

Keywords: creativity, image manipulation, non-linear interaction model, on-demand 
previews, open-ended tasks, side view 



18 Capturing, structurin g , and representing ubiquitous audio 
^ Debby Hindus, Chris Schmandt, Chris Horner 

October 1993 ACM Transactions on Information Systems (TOIS), volume n issue 4 

Publisher: ACM Press 

Full text available* fi3pdf(1 78 MB) Additional Information: full citation , abstract , references , citings, index 
|A| — terms 

Although talking is an integral part of collaboration, there has been little computer 
support for acquiring and accessing the contents of conversations. Our approach has 
focused on ubiquitous audio, or the unobtrusive capture of speech interactions in 
everyday work environments. Speech recognition technology cannot yet transcribe fluent 
conversational speech, so the words themselves are not available for organizing the 
captured interactions. Instead, the structure of an int ... 

Keywords: audio interactions, collaborative work, multimedia workstation software, 
semi-structured data, software telephony, stored speech, ubiquitous computing 



19 User modeling I: Supportin g user hypotheses in problem diagnosis 
Earl J. Wagner, Henry Lieberman 

January 2004 Proceedings of the 9th international conference on Intelligent user 
interface 

Publisher: ACM Press 

Full text available: ^ pdf(745.07 KB) Additional Information: full citation , abstract , references , index terms 

People are performing increasingly complicated actions on the web, such as automated 
purchases involving multiple sites. Things often go wrong, however, and it can be difficult 
to diagnose a problem in a complex process. Information must be integrated from 
multiple sites before relations among processes and data can be visualized and 
understood. Once the source of a problem has been diagnosed, it can be tedious to 
explain the process of diagnosis to others, and difficult to review the steps late ... 




http://portal.acm.o^ 1/26/2006 



Results (page 1): user action capturing Page 7 of 7 



Keywords: interactive visualization, interface agents, web interfaces 



20 Im plicit interest indicators 

Mark Claypool, Phong Le, Makoto Wased, David Brown 

January 2001 Proceedings of the 6th international conference on Intelligent user 
interfaces 

Publisher: ACM Press 

Full text available: f Bpdf(618.26 KB) Addjtional Information: full citation , abstract , references , citings, index 

: terms 

Recommender systems provide personalized suggestions about items that users will find 
interesting. Typically, recommender systems require a user interface that can 

intelligently" determine the interest of a user and use this information to make 
suggestions. The common solution, 1 "explicit ratings", where users tell the system what 
they think about a piece of information, is well-understood and fairly precise. However, 
having to stop to enter explicit ratings can alter normal patterns ... 
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